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Abstract 

In this paper we provide a set of distributed stability conditions for linear time-invariant networked control systems with 
arbitrary topology, using a Lyapunov direct approach. We then use these stability conditions to provide a novel approach for the 
design of a sparse, distributed, observer-based control network. The sparsity of the control network is motivated by the desire 
to minimize its cost and complexity. We employ distributed observers by employing the output of other nodes to improve the 
stability of each observer dynamics. To avoid unbounded growth of local controller and observer gains, we impose bounds on the 
norm of controller and observer gains. The effects of relaxation of these bounds is discussed. 

Index Terms 

Networked control systems. Distributed observer-based control. Linear time-invariant systems. Sparse control network 

I. Introduction 

Control systems with spatially distributed components have been in use for several decades. In early systems, the components 
were connected via dedicated hard-wired connections which carried the information from the sensors to a central location, 
where control signals were computed and sent to the actuators. Today, advances in computing and communications technology 
have provided us with low cost and low power processing capability and have enabled us to exchange information via efficient 
communication networks. These advances have considerably widened the scope of the research on spatially distributed control 
systems to include communications and network effects explicitly, as they significantly affect the dynamic behavior of the 
entire system. 

Spatially distributed control systems can be abstracted within the framework of networked control systems (NCS). An NCS 
consists of a number of subsystems, each comprising of a plant and a controller, coupled together in a network structure. 
The interaction of plants with each other forms the plant network. Control signals are exchanged using the control networl^ 
(Fig. [TJ. Networked control systems have a wide range of applications including electrical power networks |r|, transportation 
networks IJ], factory automation |[3l, tele-operations [4] and sensor and actuator networks |I5|. 

Within this framework, a centralized control approach can be modeled by considering a complete control network, which 
provides all controllers with access to the states of all plants. However, in general, it is not practical to control a large-scale 
networked system with the centralized approach, where the control law uses the state information of all subsystems, as this 
requires a large and costly control network for exchanging state information. To overcome this limitation, we must resort 
to decentralized or distributed control strategies The decentralized control strategy lies at the opposite end of the 

spectrum from the centralized approach, where the control law uses only a subsystem's local state information to control 
the given subsystem. In other words there is no control network. Such local controls can be effective when the couplings 
between subsystems are weak ifTOl - lfTSl . However, when the coupling between subsystems are not weak, we may have to use 
a distributed control approach, where each subsystem uses its own state as well as the state of some other subsystems. This 
is a middle-of-the-road solution, between centralized and decentralized approaches. Hence, it can achieve asymptotic stability 
given stronger subsystem coupling, compared to the decentralized control strategy lfT6l. lfT7l . yet avoid the complexity and cost 
of a centralized approach. 

Whether a centralized, distributed or decentralized approach is taken, both the dynamics of each subsystem and the network 
topology, play important roles in the stability of the overall network. It is easy to verify that even if each subsystem is 
asymptotically stable in isolation, the connected plants may be unstable due to the interactions between them. In such a 
scenario to stabilize the NCS a control network carrying state or feedback information between different subsystems may be 
necessary. 

A. Related Literature 

In general, the networked control literature can be classified into two main groups. The first group focuses on the effects of 
the impairments and limitations imposed by closing a feedback loop through a communication channel, including bandwidth 
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Fig. 1. A Networked Control System (NCS) 



constraint, packet dropout, sampling and delay [T8l-f27l. The second group, in which this work should be placed, considers the 
topological and network effects, and investigates how the topology of the plant network affects the overall network behavior, 
and how a control network can be designed that results in stability or desired performance. 

For both decentralized and distributed control approaches, existing works have studied the problem of imposing a priori 
constraints on communication requirements between subsystems. It has been shown that under a structural condition, namely 
quadratic invariance, finding optimal controllers can be cast as a convex optimization problem Il28l - ll32l . Other work have 
shown similar results, conditioned on the network being a partially ordered set (poset) fSSl-fSSl. This constraint is closely 
related to quadratic invariance, however, it can lead to more computationally efficient solutions and provides better insight into 
the topology of the optimal controllers. 

While these results are both elegant and important, they impose restrictions on the topology of the plant network. For networks 
with arbitrary topology, the key question concerning the design of the control network is one of topological information 
requirements and can be framed as: Which nodes should be given the state and output information of a particular node, 
in order for the local controllers to be able to satisfy a global control objective? This question is critical in the design of 
massively distributed control systems, such as the Smart Grid |[T1. ||36| - ||39J . In addressing this key question, the goal is often 
to minimize the cost and complexity of the control network. These goals take the form of sparsity constraints or objective 
functions, assuming that the cost of a link is fixed. This problem has been considered in various settings and solutions have 
been proposed that can be used to find suboptimal controllers B0l - ll42ll . 



B. Our Contribution 

In this paper, we first develop a set of distributed stability conditions that guarantee global asymptotic stability, using the 
Lyapunov direct method. These conditions extend our prior results in [43 | by inclusion of state estimation, among other 
improvements. We then use these conditions to explore the problem of designing a sparse observer-controller network for a 
given plant network with arbitrary topology. We therefore take a broader look at the topological information requirements by 
taking into account the distributed state estimation problem, generally neglected by the existing works. We proceed to provide 
a solution for finding the sparsest observer-controller network that satisfies our set of stability conditions. 

Our setting is based on a linear time-invariant (LTI) NCS with arbitrary topology. We assume that each local controller 
includes a state observer to estimate the local states. We design distributed observers and controllers that use outputs and 
estimated states from potentially all other subsystems to improve the stability of observer dynamics and provide the control 
signals to the subsystems. We assume the controllers communicate with each other through a perfect control network to 
exchange estimated state and control signal information. By perfect, we mean that communication links do not have any 
bandwidth limitation, data loss or induced network delays. We assume that the cost of all links are identical, regardless of how 
much information they carry. Therefore, the goal of reducing the cost of the control network is equivalent to minimizing the 
number of its links while guaranteeing global stability. 

The remaining of this paper is organized as follows. Section |Il] establishes our notation and describes the networked control 



system under consideration. Section III derives stability conditions that guarantees global asymptotic stability of the overall 
network. In Section |IV] we design the control network with minimum necessary number of links that satisfy the network 
stability conditions. In Section [V] we demonstrate our proposed approach using numerical examples. Concluding remarks are 



given in Section VI 
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II. Notation and Problem Definition 

1 ) Notation: We use M.^- and M++ to denote the sets of non-negative real and positive real numbers, respectively. The set 
of real n-vectors is denoted by M", the set of real mx n matrices is denoted by M™^", and the set of real symmetric positive 
definite nxn matrices is denoted by S"_|_. Matrices and vectors are denoted by capital and lower-case bold letters, respectively. 
The symbol ^ (and its strict form ^) is used to denote generalized matrix inequality defined by the positive definite cone 
between symmetric matrices. The Euclidean (I2) vector norm is represented by || • ||. When applied to a matrix || • || denotes 
the induced I2 norm, or spectral matrix norm: ||A|p — Amax(A-^A) = a^^,^{A). By Ajnin(B), Amax(B) and crniax(A) we 
denote the smallest and largest eigenvalues of symmetric matrix B and the largest singular value of matrix A, respectively. 
I„ G M"^" is the identity matrix. We let J\f denote the set {1,2,..., N}. The cardinality of a set is denoted by | • | and the 
indicator function of x is represented by l^- 

2) Problem Definition: The system under study is a collection of N coupled linear time-invariant subsystems, each com- 
prising of a plant and a controller The state of the ith plant, which may be affected by all other subsystems, is a function 
Xi(i) : -)• ]R"% governed by 

y,(t) = C,x,(i), (1) 

where Ni = N — {i\ and rii is the state space dimension of subsystem i. The signal \ii{t) : — > M™' is the control signal 
generated by the ith controller, where to,; is the dimension of the control set and [t) : IR+ — > is the output of subsystem 
i with dimension r,. A^, B^, C, and H^j are constant known matrices with compatible size. We consider an arbitrary directed 
network. That is, H^j and Hj^ are not necessarily equal. We assume that (Ai,Bi) is fully controllable and (A^, C,) is fully 
observable. We look for distributed stabilizing observer-based controller of the form 

k,{t) = A,x,(<) + B,u,(i) + ^ H,,xj(i) + M,(C,x,;(0 - y,{t)) + ^ 0,,(CjX,(t) - y,(t)), 

u,(i) = K,i,(i) + L,,ij(t), (2) 

where Xi(i) : M+ — > M"' is the estimate of Xi(<), and L^j are local and coupling controller gains, and M,; and are 
local and coupling observer gains, respectively. Note that to estimate Xi(t), we not only use output of subsystem i, but also 
outputs of (potentially) all other subsystems. This is dual to the concept of distributed control. 
We also consider constraints 

||K,|| < K,, ||M,|| < ||L,y|| < ||0,,|| < t^y, (3) 



to avoid undesirably large gains. Later (see Section IV 1, we will discuss the effect of relaxation of these constraints. 

Our objective is to find distributed observer-based control law (j2]), using feedback from (potentially) all other subsystems to 
stabilize the plant network with a sparse control network. That is, we need to find K^, M^, and O^, such that the overall 
network is globally asymptotically stable and that the number of links in the control network (number of non-zero coupling 
gains Lij and 0^^) is minimized. 

By defining error signal e.i{t) = Xi(t) — Xi(t) and substituting Xi(<) in ([T]) and (j2|, the controlled system reduces to 

x,(<) = (A, + B,K,)x,(i) + Y (B«L,, + H,j)xj(i) + B,K,e,(0 + ^ B,L,jej(i), (4) 
e,(t) = (A, + M,C,)e,(i) + ^ (0,jC, + H,,)e,(t). (5) 

This is a networked linear cascade dynamical system with the equilibrium point (x, e) — (0, 0), where x — [ x^ x^ ■ ■ ■ x^ 

and e = [ ■ ■ ■ ej^ ]'^. 



III. Network Stability Conditions 

In this section we derive conditions that assure the entire network is globally asymptotically stable. To do this, we will use 
the following lemma to find network stability conditions that guarantee Q and ^ are globally asymptotically stable. 

Lemma 1 |44|, |45|: If the system (|4|, with e(t) viewed as the input, is input-to-state stable and the equilibrium point of 
(j5]l, which is e = 0, is globally asymptotically stable, then the equilibrium point of the networked linear cascade dynamical 
system Q and (jsjl, which is (x, e) = (0, 0), is globally asymptotically stable. 

Based on this lemma, we provide the following theorems: 
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Theorem T. System Q is input-to-state stable if there exist K,;, Ljj, and Ay such that 

(A, + B.KO^P^ + P.(A, + B,K,) + [P.(B,Ly + H,,)A-/(B,L,j + H,,)^P, + A,^] -< 0, 



J6M 



for all i,k e TV.. 

Proof: Consider the quadratic Lyapunov function for each isolated subsystem i as 



P^,A,k >- 0, 



where P; e ^+'+- Then, a good quadratic Lyapunov function candidate for the entire network, V 

y(x) = ^y,(x,) = 5]xfP,;X,. 

Taking derivative of (|7]l along the trajectories of unforced system Q, we have 
F,(x,) =xfPiXi +xfP,x, 

= xf [(A, + B.KO^P^ + P^(A, + B,K,)] X, + 2 ^ xf P,(B,Ly + Hy)xj. 

To upper bound the cross terms in ([9|l, we use the following inequality which is a special case of Fenchel's inequaUty 

For any z e M", y e R"\ R e M"^™ and A e §!f:+ we have 

2z^Ry < Az + y'^R'^A^^Ry. 
Hence, (j9]l can be upper bounded, using (lOi, as 

F,(x,0 < xf [(A, + B,K,)^P^ + P.(A. + B,K,)] x, 

+ J2 [xf P.(B,L,, + H,,)A^T.i(B,L,, + H„)^P,x, + xJA,,x,] . 

Therefore, for the entire system we have 

F(x) - J2 ^^(^'') 

< ^ xf [(A, + B,K,)^P. + P.(A, + B,K,)] X, 

+ [xf P.(B.Ly + H,j) A-/(B,L,j + H„-)^P^x, + xJA^-.x,] . 

Using the following reorganization of the terms 



(6) 



(7) 



(8) 



(9) 



(10) 



(11) 



E E ''J^j^^i = E E 



(12) 



(13) 



^T2\ can be written as 



y(x) <Y.xJ [(A, + B,K,)^P. + P. (A, + B,K,) 



- J2 (P»(B»L,, + H,,)A7/(B,L,, + U,jfP, + A, 



(14) 



To ensure V^(x) < 0, it suffices for its upper bound in (14 1 to be negative. Therefore, (jHjl is a sufficient condition that guarantees 
global asymptotic stability of the equilibrium point x = of unforced system (j4]). In other words, if (j6|l holds, the system (j4]) 
is input-to-state stable. ■ 
Theorem 2: The equilibrium point, e = 0, of ([sjl is globally asymptotically stable, if there exist M^, O^, P^ and Aij such 
that 

(A, + M,Q)^Pz + P,(A, + M,C,) + J2 [(Oj^C, + H,,)^A7/(0,,Q + H,,) + P,A„-P, 



^0, 

P„A,fe)^0, (15) 



for all i,k eAf. 
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Proof: Dual of the proof of Theorem 1 . 
Corollary 1: The control network can be limited to be a subset of the plant network with no loss in its sparsity. 



Proof: The terms involving Hj^ in (|6]l and (15 i are positive semidefinite. Thus, for any i,j where H^j = 0, the best 
margin to satisfy (|6]) and (15i can be achieved by choosing = 0^^ 
link. In other words, if there is a solution with non-zero L^, and 



0, which is equivalent to completely decoupling the 
where = 0, a sparser solution can be found by 



setting Lij = — 0. Thus, the control network need not have a link where there is no link in the plant network, and the 
sparsest control network will always be a subset of the plant network. 

We can incorporate Corollary 1 into our network stability criteria by defining A/J" = {j 



j 7^ i, Hij 7^ 0} as the set of 



Hji ^ 0} as the set of neighbors that are affected by subsystem 
' which changes the right hand side of equation (13 1 with A/J""', 



neighbors that affect subsystem i and Af°"^ = {j \j 7^ i, 
i. By replacing JVi in equations ([Tl, (j2jl, ( [4|) a nd (jsj) with . 
then our network stability criteria (61) and (|l5[) become 

(A, + B,K,)^P, + P,(A, + B,KO+ ^ P.(B,L,, +H,j)A-/(B,L,j+H,,fP,+ ^ A,, ^ 0, 

P„A,fc^O, (16) 

and 

(A,+M,Q)^P«+P,(A, + M,Q)+ (Oj»Q + Hj,)^A7/(0,,Q + Hj,)+ P.^.^P, ^ 0, 

P„A,fe^O, (17) 

for a\\i,k G Af respectively. Recall that in general A/]" ^ A/J"", which means that neighborhoods is not necessarily a symmetric 
relation (i.e. the network is directed). 

Theorem 3: The equilibrium point of the networked linear cascade dynamical systems (j4| and (jsjl, which is (x, e) — (0, 0), 
is globally asymptotically stable if ( 16 1 and ( 17 1 are satisfied for all i,k E N. 

Proof: Follows directly from Lemma 1, Theorem 1, Theorem 2 and Corollary 1. ■ 

Corollary 2: It is always possible to stabilize the overall network, neglecting the constrains on local controller and observer 



gains, if L^j and exist that satisfy the matching conditions BjLy + = and OijCj + — 0. 



Proof: Since the matching condition is satisfied for all links, the subsystem's dynamics in (j4|i and (j5]l are completely 
decoupled from their neighbors. Using controllability of (Ai,Bi) and observability of (Ai,Ci), we can find local feedback 
gains Ki and such that A^ + BiKi and A^ + MiCi have arbitrary desired eigenvalues in the open left-half complex plane. 
This means that a control network identical to the plant network will stabilize the system, though it may not be sparse. ■ 
Using Theorem 3, our objective is now to satisfy the set of inequalities (16i and (17i with given bounds in ([3]l. This is a 
feasibility problem in the sense that we need to find P^ 
satisfied. 



Pi, Ki, Mi, 'Lij, Oij, and A^ such that and ([l7| are 



IV. Sparse Control Network Design 

As discussed in Section |l] the goal of designing a sparse control network is inspired by cost minimization assuming that the 
links have a fixed cost. Therefore, the goal of reducing the cost of the communications network is equivalent to minimizing 
the number of links in the communications network while guaranteeing system stability. 

In this section we aim to design a control network with minimum number of necessary links that satisfy general stability 



conditions (16i and (17i. That is, we need to find observers and controllers satisfying stability conditions with minimum 



number of non-zero Lij and Oij. This problem can be formulated as 



rmmrmze 



EE 



{Lij^O or Oij^O} 



(18) 



subject to (|3]l, ([T6]l and ([T7| 



for all i,k £ Af. The optimization variables in (18 1 are K^, , P^, A^, , M.^, 0,y , P.; and Ai,-. Unfortunately, besides the 



fact that the objective function is integer valued, the first two constraints of this optimization problem are non-convex. In the 
following we show that this problem can be convexified by restricting its domain as follows: 

Theorem 4: Consider the system in ([T]i with observer-based controller of the form (j2]i and bounds in (|3]l. The overall network 
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minimize 



is globally asymptotically stable if the following convex mixed-binary program has a solution 

J2 

F,(Z„W„a,y) 



(19) 



subject to 



^0, (CI) 
^0, (C2) 



Z. y 0, (C3) 

Z, >- 0, (C4) 

/C,A„,in(Z,) - (Tmax(W,) > 0, (C5) 

fi^XMn{^^) " (Tmax(W,) > 0, (C6) 

a,fce{0,l}, (C7) 



for all i, fc e Af, where 

F,(Z„W„a,,) 



WfB?^ - B, W, 



and 



F,(Z„W„aj 



-AfZ,, - Z„;A,; - CTWT - W,,C, 



E 



I^HjjHjj + ajt (^G*i G*j 



(20) 



(21) 



Furthermore, if (W*, W*, Z*, Z*,a*j) is a solution of ( [T9| l, the controller and observer gains are 

-1 , 



K, = W* (Z*)- 



M,: = ( Z 
O, 



H 



W* 
+ H 



L*, = arg min||BiL,j 4 
O*, = arg min||0,j Cj 



H 



subject to||Lij|| < Lij, 
subject to||Ojj|| < ujij. 



(22) 



Proof: Let us apply the congruence transformations by pre-multiplying and post-multiplying (16i by ^, which always 
exists due to the positive definiteness of P^. We restrict the feasibility domain to A^j = Sin- where S E By defining 



(23) 



new variables Z^ = SP^ and = <^KjPj , we can write (|16| as 

I A/;™' I Z2 + Z,Af + A,Z, + Wf Bf + B,W, + ^ (B,L,, + H,j)(B,L,j + H,,)^ -< 0, 

Z, ^ 0. 



The original variables can be obtained from these new variables: P; = SZ^ ^ and — W^Zj ^. Note that the controller gain 
Kj is not a function of S. Thus, 6 only scales Pj, and without loss of generality, we can assume ^ = 1. 



To satisfy ( 23 1, we can upper bound the last term by 
(B^Lij 



- Hij)(BiLi 



(24) 



Thus, we can design in (23 i such that it minimizes Amax[(BiLij + H,y)(BiLij + Hij)'^] while satisfying (jsj. That is 



T * 



= arg min||BiL,y + 
subject to||L.y|| < Lij. 



(25) 



This suggests that our aim is to decouple each link Hij in Q using the link B^Lij, in Euclidean norm sense, as much as 
possible. Obviously, if the matching condition B^Ly + Hy = can be satisfied, the link is completely decoupled, as stated 
in Corollary 2. Problem ( 25 1 is a matrix spectral norm minimization which can be written as a standard semidefinite program 
(see Appendix), which is readily solved. 

We can now proceed to design a sparse control network. That is, we seek a set of Ljj that guarantee asymptotic stability, 
with minimum number of non-zero Ljj. Recall that when we do include the zjth link in the communications network, we 
should use the gain L* . On the other hand when the ij\h link is not used we have hij = 0. 
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Define binary variables Uij E {0, 1} associated to each link L^j. The variable = 1 if the ijth link is used in the control 



network and a,:j = if it is not used. This means that 



Lij — aijL*j. 



(26) 



To find the variables and W; in ( 23 i, we use the Schur complement lemma BtI and rewrite ( 23 1 as the following feasibility 
problem 



F,(Z„W„a,j) 



^0, 

Z, >- 0, 

aik e {0, 1}, 



(27) 



for all i,k e J\f. 

While changing the variables from and to Zj and convexified the first two constraints in ( 18 1, it caused the local 
gain constraint Q to become non-convex. To remedy this, we can convexify this constraint by first upper bounding the norm 
of Ki as 

I1K.I1 = ||W,Z-i|l 

<l|w.||||zri|| 

= fT„,ax(W,)An,ax(Z,-l) 
_ q-max(Wi) 
•^min(Zi) 



and forcing Q by bounding ( 28 i by Ki 



Equivalently 



IK,; 



^ crmax(Wi) 

< 7^— < K,, 



KAmin(Zi) - crmax(Wi) > 0, 



(28) 



(29) 



(30) 



which is a convex constraint. Equations (27 1 and ( [30) l together, give constraints (CI), (C3), (C5) and (C7) in (19 1. 

Similarly, we can convexify the general stability condition (17i with given bounds in (j3]l as constraints (C2), (C4) and (C6) 
in (19 1 where A^- = 61^,6 e Z^ = 5Pi and = SPiMi. Note that if link ij is used we can communicate both 

LyXj (t) and Oijyj{t) on the same link. This means the same binary variables a^j should be used for both controller and 
observer links. Thus, — aijO*j, where 



O*. = arg min||OyCj- 



H, 



(31) 

1, or in other words. 



subject to||Oij|| < ujij. 

Minimizing the number of communication links is equivalent to minimizing the number of aij 
minimizing the sum of all aij subject to constraints in (19 1. ■ 

Corollary 3: Decentralized control is possible if there are no bounds on the norms of local gains, i.e. = /i^ = oo, and for 
each i we have either 

• BiBf is non-singular, or 

. I A/;™' I I„. + Af + A, + E H„-H,^. ^ 0, 

and, either 

• CfCi is non-singular, or 

. I A/;» I I„. + Af + A, + E HJ,H,, -< 0. 

Proof: Consider a decentralized solution of the form — 0, Zi = I„. and = — /3Bf where /? e 
satisfies constraint (C3) in (19^ . Now, considering constraint (CI) in ([T9|, in the form of ( |23| l, we need 



2l3B,Bi + V H,,HJ:. ^ 0, 



•-tj '-Hj 



Clearly, this 
(32) 



or equivalently 



Aj + A, + ^ H,,H^- ^ 2/3B,B^ 



(33) 
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We can upper bound the left hand side by 

I Mr I + Af + A, + J2 H^jH^- ^1 A/;™' I In, + A,nax j Af + A, + ^ H,,H^- j I„., (34) 
and lower bound the right hand side by 

2/3A„,in (B,Bf ) ^ 2/3B,Bf . (35) 
Thus for ( (33] i to be satisfied, it suffices to have 

I I +Amax ^Af + A, + H,,H^- j < 2/3A„,i„ (B,Bf ) . (36) 

If B^B^ is non-singular, any 

I I +Amax Uf + A, + E H.,H^. j 

/?> 7 y/^"^'" ^, (37) 

will satisfy ( |33| l. If B^Bf is singular, we have Amin (B,;Bf ) = and we need 

I Mr I +Amax I Af + A, + ^ H,jH^. I < 0, (38) 



or 

I A/;™' I I„, + Af + A, + ^ H,;,H^. ^ 0. (39) 



The argument for constraint (C2) in ( [T9] l is similar. 



Equation (19i is a convex mixed-binary program, which in general is known to be NP-hard. In the worst case, we have 
a complete binary tree of depth E, where E is the total number of edges in the plant network. This means that one has to 
solve 2^ convex problems, carrying an exhaustive search on the binary variables. While a variety of exact methods for convex 
mixed-binary programs are available Il48l - ll50l . their computational complexity is prohibitive for large networks. Here, we use 
a suboptimal simple relaxation approach, as follows: 



1) Solve ([T9| with (C7) relaxed to < aij < 1 to obtain solution a^^^ satisfy (CI) through (C6). 

2) Solve 



maximize r = ai, 

k,i (40) 



subject to Uij — Ur {a\y ) satisfy (CI) thi'ough (C6) 
where 



- i : ^(i) : ■ (41) 

3) Return = u^* (a.-J''), where r* is the solution of ( |40j l. 
Note that the complexity of (|40]i is only logi?, since it can be solved by using a binary search on r in a sorted set of {Q:|!f^^}. 



a^:^ < T 



V. Numerical Example 

This section presents a numerical example demonstrating our approach in distributed observer and controller design for 
distributed networked control systems with a sparse control network. The system under study (Fig. [2]| is a collection of three 
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Fig. 2. Network of three coupled subsystems 



LTI subsystems coupled together. We assume the following parameters: 
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A2 = 

A3 = 

H12 - 
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(42) 



We will consider three different cases, where we progressively increase and fii. Since the subsystems are controllable and 
observable, we can apply Theorem 4 to design distributed observers and controllers that stabilize the entire network with small 



number of links in the control network. First, we need to find L*. and O*. that are the solutions of norm minimization ( 25 1 

<'j ''J 



and (31 1 respectively. We assume there are no bounds on the norms of coupling gains, i.e. Lij = ujij = 00. The results are 
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(43) 



As we showed in Section IV, the controller gain and observer gain are not a function of S and S respectively. Thus 
without loss of generality, we set (5 = j = 1. To solve the convex mixed-binary program 
approach as well as the suboptimal algorithm provided in Section IV. 



19 1 we will use both an exhaustive 



Case 1: 

We start with more stringent bounds ni = K2 = kj, = 8, Mi — /^2 = M3 = 4. Using the relaxation approach, we find 
= 1, = 0.69, ~ 0.83, 032 = 0.20 which after thresholding yield — a2i — 0^23 — '^32 " 1 '^^^ 

Ki = [-2.32 -1.82 ], K2 =[ -2.86 -0.07 ], K3 =[ -1.56 0.26 ], 
MJ ^ [ -3.65 -0.09 ] , [ -1.10 0.50 ] , =[ -1.70 0.35 ] . (44) 

The resulting gain norms are 

IIKill = 2.95, IIK2II = 2.86, IIK3II = 1.58, 

IIMill = 3.65, IIM2II - 1.21, IIM3II = 1.74, (45) 
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which are inside the defined bounds. The gap between the norms in ( |45| ) and the bounds is due to conservatism of the bounds 
on controller gains and observer gains as (C5) and (C6) in ( 19 1. 

Using an exhaustive search on the binary variables, followed by convex optimization of other variables, we solve convex 
mixed-binary program ( 19l to find the optimal solution a*2 — aJi = ct23 — '^32 — 1' which is the same result obtained from 
the thresholding approach. Consequently, and are also the same. 



Case 2: 

Relaxing the bounds on local gains may make it possible to stabilize the network with fewer number of links. Assuming 

(r) (r) 

Ki = K2 = K3 = 9, /ii = = Ms = 5 and solving the convex relaxation problem, we get al^ = 0.99, Ofji = 0.23 x 
10^^, a^23 — 0.80, a32'' — 0.66x 10~^. After thresholding, the entire network is stabilized with = a\;j = 1, a\-^ = = 
and 

Ki = [ -2.38 -1.88 ] , K2 = [ -4.03 0.77 ] , K3 = [ -4.21 -1.99 ] , 

= [ -4.08 -0.17 ] , = [ -3.24 -1.08 ] , M^^ = [ -1.84 0.40 ] . (46) 



Norms of the local gains are 



|Ki|| = 3.03, IIK2II = 4.10, IIK3II = 4.66, 

|Mi|| = 4.09, IIM2II = 3.41, IIM3II = 1.88. (47) 



We see that with these relaxed bounds, only two links are needed to stabilize the entire network. Using the exhaustive search, 
we find the optimal solution a* 2 = oi23 ~ 1' '^21 ~ '^32 — which, once again, is the same result obtained from the 
suboptimal approach. 



Case 3: 

Finally, by further relaxing the bounds to ki = K2 = K3 = 17, Mi = M2 = ^3 = 15, even without any links the network 
is globally asymptotically stable. Solving the convex relaxation problem, we get a^j"* — '^21 — '^23 — '^32 — O-^O x 10^^^, 
which after thresholding yield ~ a\i — 023 = 0^32 — ^^'^ 

Ki = [ -6.05 -8.55 ] , K2 = [ -6.10 -1.20 ] , K3 = [ -4.02 -2.08 ] , 
Mf = [ -4.97 0.00 ] , = [ -5.90 -2.39 ] , ^ [ -3.08 0.34 ] . (48) 

Now the norms of local gains are 

IIKill = 10.47, IIK2II = 6.21, IIK3II - 4.53, 

||Mij| = 4.97, IIM2II = 6.36, IIM3II = 3.10. (49) 

We can see that, even though neither of conditions of Corollary 3 are satisfied in this example, as and Ci have rank 1 and 
Ai are unstable, this relaxation of the bounds makes a completely decentralized approach feasible. This is because of Corollary 
3 is a sufficient condition for decentralization. Of course, the exhaustive search approach provides the same solution. 



Case 4: 

To show that relaxing the bounds does not necessarily make decentralized control feasible, we provide a counter example. 



Consider the system in (42i but double the coupling matrices H^. Then, the convex mixed-binary problem (19i is infeasible 



even without constraints (C5) and (C6) in (19 1. Moreover, note that neither of conditions of Corollary 3 which is a sufficient 
condition for complete decentralization are satisfied in this example. 



VI. Concluding Remarks 

We have provided a design approach for distributed observer-based controllers for stabilization of networked control systems 
consisting of multiple coupled linear time-invariant subsystems over an arbitrary directed network. To measure states of each 
subsystem, we use the outputs of other nodes to improve stability of observer dynamics, in an approach dual to that of 
distributed controllers. Our design approach is based on a set of stability conditions obtained using the Lyapunov approach, 
and provides a sparse observer-controller network which guarantees global asymptotic stability. Moreover, we showed that the 
controller-observer network can always be a subset of the plant network. That is, it need not have any links, where one does 
not exist in the plant network. 

Of course, inherited from the Lyapunov approach as well as assumptions made to maintain tractability, the design includes 
some degree of conservatism. Thus, although the results provide us with significant insight into the problem of designing the 
sparsest controller-observer network, a gap still remains. Quantification or reduction of this conservatism will be quite valuable. 
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Also of interest is the issues of convergence rate and robustness. In search of a sparse controller-observer network, we have 
spent the entire margin in at least one of our distributed stability criteria. This means that the resulting system has very low 
rate of convergence. Moreover, since there is no margin left, disturbances and model uncertainty can make the system unstable. 
Of course, one can add a given preset margin to each inequality. However, it is not clear how best this margin should be 
distributed among the inequalities to improve the convergence rate and make the network robust, without significantly growing 
the size of the controller-observer network. It is also interesting to understand the tradeoff between the margin and the sparsity 
of the observer-controller network. 

We believe that the results presented in this paper provide a foothold for further progress towards understanding these 
interesting and important problems. 



Appendix 
Finding L* and O* 

Using the fact that ||B,iLij + ilijW < Sij if and only if (B,;L,y + Hij)(BiL,y + Hy)^ ^ sfjljii Sij G M+, we can 
express the optimization problem ( p5| l in its epigraph form 

minimize (50) 

subject to (BiL,y + Hij)(BjLij + H^)^ ^ sfjl^,, 

■T J ,1 



which after applying Schur complement lemma is equivalent to 

minimize sa 



(51) 



subject to 



T'T / - T 



^ 0, 



>- 0. 



This is a standard semidefinite program (SDP), and can be readily solved [46 j . The argument for O*^ in the optimization 
problem pT| ) is the same. 
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